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Abstract 

Recently Friedman proved Alon's conjecture for many families of d-regular graphs, namely 
that given any e > "most" graphs have their largest non-trivial eigenvalue at most 2yJ d — 1 + 
e in absolute value; if the absolute value of the largest non-trivial eigenvalue is at most 
2\/rf — 1 then the graph is said to be Ramanujan. These graphs have important applications 
in communication network theory, allowing the construction of superconcentrators and non- 
blocking networks, coding theory and cryptography. As many of these applications depend on 
the size of the largest non-trivial positive and negative eigenvalues, it is natural to investigate 
their distributions. We show these are well-modeled by the /3 = 1 Tracy-Widom distribu- 
tion for several families. If the observed growth rates of the mean and standard deviation as 
a function of the number of vertices holds in the limit, then in the limit approximately 52% 
of d-regular graphs from bipartite families should be Ramanujan, and about 27% from non- 
bipartite families (assuming the largest positive and negative eigenvalues are independent). 

1 Introduction 

1.1 Families of Graphs 

In this paper we investigate the distribution of the largest non-trivial eigenvalues associated to 
d-regular undirected graphfl A graph G is bipartite if the vertex set of G can be split into two 
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disjoint sets A and B such that every edge connects a vertex in A with one in B, and G is d- 
regular if every vertex is connected to exactly d vertices. To any graph G we may associate 
a real symmetric matrix, called its adjacency matrix, by setting to be the number of edges 
connecting vertices i and j. Let us write the eigenvalues of G by Ai(G) > • • • > Xn{G), where 
G has N vertices. We call any eigenvalue equal to ±d a trivial eigenvalue (there is an eigenvalue 
of —d if and only if the graph is bipartite), and all other eigenvalues are called non-trivial. 

The eigenvalues of the adjacency matrix provide much information about the graph. We 
give two such properties to motivate investigations of the eigenvalues; see BDSVIISarTI for more 
details. 

First, if G is d-regular then Xi{G) = d (the corresponding eigenvector is all I's); further, 
A2 (G) < c? if and only if G is connected. Thus if we think of our graph as a network, A2 (G) tells 
us whether or not all nodes can communicate with each other For network purposes, it is natural 
to restrict to connected graphs without self-loops. 

Second, a fundamental problem is to construct a well-connected network so that each node 
can communicate with any other node "quickly" (i.e., there is a short path of edges connecting any 
two vertices). While a simple solution is to take the complete graph as our network, these graphs 
are expensive: there are N vertices and (^) = N{N — l)/2 edges. We want a well-connected 
network where the number of edges grows linearly with N. Let V be the set of vertices for a 
graph G, and E its set of edges. The boundary dU of a [/ C is the set of edges connecting U 
toV\U. The expanding constant h{G) is 



and measures the connectivity of G. If {Gm} is a family of connected d-regular graphs, then 
we call {Gm} a family of expanders if limm_^oo \Gm\ — 00 and there exists an e > such 
that for all m, h{Gm) > e. Expanders have two very important properties: they are sparse {\E\ 
grows at most linearly with \V\), and they are highly connected (the expanding constants have 
a positive lower bound). These graphs have important applications in communication network 
theory, allowing the construction of superconcentrators and nonblocking networks BBienl IpH . 
as well as applications to coding theory [SS| and cryptography liGILVZl : see IISar2l for a brief 
introduction to expanders. The Cheeger-Buser inequalities (due to Alon and Milman BAMl 
and Dodziuk [Do]) give upper and lower bounds for the expanding constant of a finite d-regular 
connected graph in terms of the spectral gap (the separation between the first and second largest 
eigenvalues) d — A2(G): 



Thus we have a family of expanders if and only if there exists an e > such that for all m, 
d — \i(Gm) > e- Finding graphs with small A2(G) lead to large spectral gaps and thus sparse, 
highly connected graphs. 

For many problems, the behavior is controlled by the largest absolute value of a non-trivial 
eigenvalue. We write A+(G) (resp., A_(G)) for the largest non-trivial positive eigenvalue (resp., 
the most negative non-trivial eigenvalue) of G, and set A(G) = max ( | A+ (G) | , | A_ (G) |) . Alon- 
Boppana, Burger, and Serre proved that for any family {G„i} of finite connected d-regular graphs 

^The name is from an analogy with the isoperimetric constant of a compact Riemann manifold. 
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with lim„i^oo \G,n \ = oo, we have liminf„i^oo A(Gm) > 2\J d — 1; in fact, Friedman OFrll 
proved that if G is a d-regular (d > 3) graph with n vertices, then 

27T^ „ / 1 



XiG) > 2Vd^- [l-j. ^ + 7^ ^ . (1.3) 

Thus we are led to search for graphs with A(G) < 2\/d — 1; such graphs are called Ramanujar0 
(see MMurl for a nice survey). Explicit constructions are known when d is 3 IChiul or q + 1, 
where q is either an odd prime [LPS' Marl or a prime power fMo?| . 

Alon [,A1] conjectured that as ^ 00, for d> 3 and any e > 0, "most" d-regular graphs on 
vertices have A(G) < 2y/d— 1 + e; it is known that the 2y/d— 1 cannot be improved upon. 
Upper bounds on A(G) of this form give a good spectral gap. Recently, Friedman [Fr2'| proved 
Alon's conjecture for many models of d-regular graphs. Our goal in this work is to numerically 
investigate the distribution of A±(G) and A(G) for these and other families of d-regular graphs. 
By identifying the limiting distribution of these eigenvalues, we are led to the conjecture that 
for many families of d-regular graphs, in the limit as the number of vertices tends to infinity the 
probability a graph in the family has A(G) < 2\/rf — 1 tends to approximately 52% if the family 
is bipartite, and about 27% otherwise. 

Specifically, consider a family J-N.d of d-regular graphs on A^ vertices. For each G G J-'N,d, 
we study 

A^(G) = |A.(G)I~2VZ3T+, 

c,,iv.d,±A-±(^«-^) 

we use TO for the first exponent as it arises from studying the means, and s for the second as it 
arises from studying the standard deviations. Our objective is to see if, as G varies in a family 
^N.d, whether or not A±(G) converges to a universal distribution as N 00. We therefore 
subtract off the sample mean and divide by the standard deviation to obtain a mean 0, variance 
1 data set, which will facilitate comparisons to candidate distributions. We write the subtracted 
mean as a sum of two terms. The first is 2\/d~ 1, the expected mean N ^ 00. The second is 
the remaining effect, which is observed to be negative (see the concluding remarks in [Fr2J and 
BHLWI ). and is found to be negative in all our experiments. We shall assume in our discussions 
below that c^,Ar,d,± < 0. Of particular interest is whether or not m±{!FN,d) — s±{!FN,d) < 
0. If this is negative (for both A±(G)), if A±(G) converges to a universal distribution, and if 
A+(G) and A_(G) are independent for the non-bipartite families, then in the limit a positive 
percent of graphs in J-N.d are not Ramanujan. This follows from the fact that, for |A-|-(G)|, 
in the limit a negligible fraction of the standard deviation suffices to move beyond 2\^d — 1; if 
m±{J^N,d) — s±{J^N.d) > then we may move many multiples of the standard deviation and 
still be below 2\/d ~ 1 (see Remark lZTI for a more detailed explanation). 

Remark 1.1 (Families of c?-regular graphs). We describe the families we investigate. For con- 
venience in our studies we always take A to be even. Friedman [Fr2| showed that for fixed 
e, for the families Gna, 'Hna and J^.d defined below, as A^ — > 00 "most" graph^ have 



'Lubotzky, Phillips and Samak ILPS] construct an infinite family of (p + l)-regular Ramanujan graphs for primes 
p = 1 mod 4. Their proof uses the Ramanujan conjecture for bounds on Fourier coefficients of cusp forms, which led 
to the name Ramanujan graphs. 

''Friedman shows that, given an e > 0. with probability at least 1 — cjr^N~^^-^<i"^ we have A(G) < 2\/d — 1 + e 
for G £ ^N,d' and with probability at least cjr^ Af"^'-^'*' we have A(G) > 2\/ d — 1; see LFr2J for the values of the 
exponents. 
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A(G) < 2^/d~^"+e. 

• BN,d- We let BN,d denote the set of d-regular bipartite graphs on N vertices. We may 
model these by letting tti denote the identity permutation and choosing d — 1 independent 
permutations of {1, ... , N/2}. For each choice we consider the graph with edge set 

E: {(z,7r,(z) + 7V/2):zG{l,...,iV/2},je{l,...,d}}. (1.5) 

• Gn.j.- For d even, let tti, . . . , 7rrf/2 be chosen independently from the iV! permutations of 
{1, . . . , N}. For each choice of tti, . . . , 7t^^2 form the graph with edge set 

E: (z,7r7i(i)):ze{l,...,iV},je{l,...,d/2}}. (1.6) 

Note GN,d can have multiple edges and self-loops, and a self-loop at vertex i contribute 2 
to a^. 

• 'HN,d- These are constructed in the same manner as GN,d, with the additional constraint 
that the permutations are chosen independently from the {N — 1)! permutations whose 
cyclic decomposition is one cycle of length TV. 

• Tna- These are constructed similarly, except instead of choosing d/2 permutations we 
choose d perfect matchings; the d matchings are independently chosen from the {N — 1)!! 
perfect matchings 

• Connected and Simple Graphs. If J^N.d is any of the families above (BN,d, QN,d, T^N,d or 
lN,d), let C!FN,d denote the subset of graphs that are connected and SCT^.d the subset of 
graphs that are simple and connected. 

Remark 1.2. The eigenvalues of bipartite graphs are symmetric about zero. We sketch the proof. 
Let G be a bipartite graph with 2N vertices. Its adjacency matrix is of the form A{G) = ^ ^ ^ ) ' 

where Z is the N x N zero matrix and _B is an x iV matrix. Let J = ^ ) where / is the 

iV X iV identity matrix. Simple calculations show J^^ = — J and J^^A(G) J = —A{G). Noting 
similar matrices have the same eigenvalues, we see the eigenvalues of A{G) must be symmetric 
about zero. 

1.2 Tracy- Widom Distributions 

We investigate in detail the distribution of A± (G) for (i-regular graphs related to two of the 
families above, the perfect matching family TN.d and the bipartite family BN.d (by Remark [L2l 
we need only study X+{G) for the bipartite family). Explicitly, for N even we study CX^r d, 
SCIjsi^d, CB^^d, and SCB^.d'^ we restrict to connected graphs as c? is a multiple eigenvalue for 
disconnected graphs. As d and N increase, so too does the time required to uniformly choose a 

^For example, if d = 3 and Af = 8, our three permutations might be (43876152), (31248675) and (87641325). 
Each permutation generates 8/2 = 4 edges. Thus the first permutation gives edges between vertices 4 and 3, between 
8 and 7, between 6 and 1, and between 5 and 2. A permutation whose cyclic decomposition is one cycle of length N 
can be written A'^ different ways (depending on which element is listed first). This permutation generates two different 
perfect matchings, depending on where we start. Note there are no self-loops. 
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simple connected graph from our families; we concentrate on d G {3, 4, 7, 10} and N < 20000. 
As there are known constructions of Ramanujan graphs for d equal to 3 or g + 1 (where q is either 
an odd prime or a prime power), d = 7 is the first instance where there is no known explicit 
construction to produce Ramanujan graphs. In the interest of space we report in detail on the 
d = 3 computations for A_|_(G). We remark briefly on the other computations and results, which 
are similar and are available upon request from the authors; much of the data and programs used 
are available at 

http : / / www . math . princeton . edu/mathlab/ ramanujan/ 

We conjecture that the distributions of X±{G) are independent in non-bipartite families and 
each converges to the /3 = 1 Tracy-Widom distribution (see Coniecture ll.3l for exact statements). 
We summarize our numerical investigations supporting this conjecture in ^1.31 and content our- 
selves here with describing why it is natural to expect the (3 — 1 Tracy-Widom distribution to 
be the answer. The Tracy-Widom distributions model the limiting distribution of the normal- 
ized largest eigenvalues for many ensembles of matrices. There are three distributions fp{s): 
(i) (3 — 1, corresponding to orthogonal symmetry (GOE); (ii) (3 = 2, corresponding to unitary 
symmetry (GUE); (iii) /3 = 4, corresponding to symplectic symmetry (GSE). These distributions 
can be expressed in terms of a particular Painleve II function, and are plotted in Figure[T] 

We describe some of the problems where the Tracy-Widom distributions arise, and why the 
(3=1 distribution should describe the distributions of A±(G). The first is in the distribution of 
the largest eigenvalue (as N — > oo) in the N x N Gaussian Orthogonal, Unitary and Symplectic 
Ensembles |TW2|. For example, consider the N x N Gaussian Orthogonal Ensemble. From the 
scaling in Wigner's Semi-Circle Law MMeh2l[Wig) , we expect the eigenvalues to be of order v^. 
Denoting the largest eigenvalue of A by Amax(^), the normalized largest eigenvalue Aniax(^) 
satisfies _ 

A„,ax(A) = 2aV]v + %)^; (1.7) 
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here a is the standard deviation of the Gaussian distribution of the off-diagonal entries, and is 
often taken to be 1 or l/\/2. As ^ cxd the distribution of Ainax(^) converges to /i(s). 
The Tracy- Widom distributions also arise in combinatorics in the analysis of the length of the 
largest increasing subsequence of a random permutation and the number of boxes in rows of 
random standard Young tableaux fBDJI IBOOl IBRTI lBR2l UoTI . in growth problems flBRSIIGTWI 
|jo3 PSl PS2|, random tilings [Jo2|, the largest principal component of covariances matrices 
ifSol . queuing theory IIBal IGTWl . and superconductors OVBABI : see IITW3II for more details and 
references. 

It is reasonable to conjecture that, appropriately normalized, the limiting distributions of 
A± (G) in the families of d-regular graphs considered by Friedman converges to the /3 = 1 Tracy- 
Widom distribution (the largest eigenvalue is always d). One reason for this is that to any graph 
G we may associate its adjacency matrix A{G), where is the number of edges connecting 
vertices i and j. Thus a family of d-regular graphs on N vertices gives us a sub-family of N x N 
real symmetric matrices, and real symmetric matrices typically have /3 = 1 symmetries. While 
McKay |McK| showed that for fixed d the density of normalized eigenvalues is different than 
the semi-circle found for the GOE (though as d ^ oo the limiting distribution does converge 
to the semi-circle), Jakobson, Miller, Rivin and Rudnick fJMRRI experimentally found that the 
spacings between adjacent normalized eigenvalues agreed with the GOE. As the spacings in the 
bulk agree in the limit, it is plausible to conjecture that the spacings at the edge agree in the limit 
as well; in particular, that the density of the normalized second largest eigenvalue converges to 



1.3 Summary of Experiments, Results and Conjectures 

We numerically investigated the eigenvalues for the families CIna, SCIna, CBN,d and SCBna- 
Most of the simulations were performed on a 1.6GHz Centrino processor running version 7 of 
Matlab over several months; the data indicates that the rate of convergence is probably controlled 
by the logarithm of the number of vertices, and thus there would not be significant gains in seeing 
the limiting behavior by switching to more powerful systems|f| The data is available at 

http : / / www . math .princeton. edu/mathlab/ ramanu jan/ 

We varied N from 26 up to 50, 000. For each N we randomly chose 1000 graphs G from 
the various ensembles, and calculated \+(G). Letting and (j^™p'° denote the mean 

' ^J'N,d,± J-N.d.± 

and standard deviation of the sample data (these are functions of TV, and limjv^oo ~ 
2\/d — 1), we studied the distribution of 

This normalizes our data to have mean and variance 1, which we compared to the /3 = 1 
Tracy-Widom distribution; as an additional test, we also compared our data to /? = 2 and 4 
Tracy- Widom distributions, as well as the standard normal. 

^In fact, many quantities and results related to these families of graphs are controlled by the logarithm of the number 
of vertices. For example, a family of graphs is said to have large girth if the girths are greater than a constant times the 
logarithm of the number of vertices (see page 10 of [DSVJ ). For another example, see il.3\ . 
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Before stating our results, we comment on some of the difficulties of these numerical inves- 
tigationsQ If g{s) is a probability distribution with mean and variance ct^, then ag{ax + jj) 
has mean and variance 1 . As we do not know the normalization constants in ( |1.4t for the sec- 
ond largest eigenvalue, it is natural to study jl.SI l and compare our sample distributions to the 
normalized /3 = 1 Tracy-Widom distributioqS In fact, even if we did know the constants it is 
still worth normalizing our data in order to determine if other distributions, appropriately scaled, 
provide good fits as well. As remarked in 31.21 there are natural reasons to suspect that the /9 = 1 
Tracy-Widom is the limiting distribution; however, as Figure |2] shows, if we normalize the three 
Tracy-Widom distributions to have mean and variance 1 then they are all extremely close to 
the standard normal. The fact that several different distributions can provide good fits to the data 
is common in random matrix theory. For example, Wigner's surmis^ for the spacings between 
adjacent normalized eigenvalues in the bulk of the spectrum is extremely close to the actual an- 
swer (and in fact Wigner's surmise is often used for comparison purposes, as it is easier to plot 
than the actual answe0)- While the two distributions are quite close (see IGaul IMehTl IMeh2l ') 
and both often provide good fits to data, they are unequal and it is the Fredholm determinant 
that is correc{3- We see a similar phenomenon, as for many of our data sets we obtain good fits 
from the three normalized Tracy-Widom distributions and the standard normal. It is therefore 
essential that we find a statistic sensitive to the subtle differences between the four normalized 
distributions. 

We record the mean, standard deviation, and the percent of the mass to the left of the mean for 
the three Tracy-Widom distributions (and the standard normal) in Table [T] The fact that the four 
distributions have different percentages of their mass to the left of the mean gives us a statistical 
test to determine which of the four distributions best models the observed data. 

Thus, in addition to comparing the distribution of the normalized eigenvalues in dl.SI ) to the 
normalized Tracy-Widom distributions, we also computed the percentage of time that A± (G) 

'Another difficulty is that the iVIatlab code was originally written to investigate bipartite graphs. The symmetry of the 
eigenvalues allowed us to just look at the second largest eigenvalue; when we ran the code for non-bipartite graphs, we 
originally did not realize this had been hardwired. Thus there we were impHcitly assuming A(G) = A-|_(G), which is 
frequently false for non-bipartite graphs. This error led us to initially conjecture 52% of these graphs are Ramanujan in 
the limit, instead of the 27% we discuss later. 

'*The Tracy-Widom distributions ITWll could have been defined in an alternate way as mean zero distributions if 
lower order terms had been subtracted off; as these terms were kept, the resulting distributions have non-zero means. 
These correction factors vanish in the limit, but for finite A'^ result in an A'^-dependent correction (we divide by a quantity 
with the same A'^-dependence, so the resulting answer is a non-zero mean). This is similar to other situations in number 
theory and random matrix theory. For example, originally "high" critical zeros of f (s) were shown to be well-modeled 
by the N ^ oo scaling limits the N X N GUE ensemble tOdlllOd2l ; however, for zeros with imaginary part about T a 
better fit is obtained by using finite N (in particular, A'^ ~ log T; see fKeSnl). 

'Wigner conjectured that as TV — > oo the spacing between adjacent normalized eigenvalues in the bulk of the spectrum 
of the N X N GOE ensemble tends to Pwi^) = i''^^/'^) sxp (— 7rs^/4) . He was led to this by assuming: (1) given an 
eigenvalue at x, the probability that another one lies s units to its right is proportional to s; (2) given an eigenvalue at x 
and Ii, I2, 13, ■ ■ ■ any disjoint intervals to the right of x, then the events of observing an eigenvalue in Ij are independent 
for all j; (3) the mean spacing between consecutive eigenvalues is 1. 

'"The distribution is {n-^ /4:)d?'^ /dt^ , where ^(t) is (up to constants) the Fredholm determinant of the operator 
/ - /with kernel = ^ (^^i^ + ^-i^). 

"while this is true for number-theoretic systems with large numbers of data points, there is often not enough data 
for physical systems to make a similar claim. The number of energy levels from heavy nuclei in nuclear physics is 
typically between 100 and 2000, which can be insufficient to distinguish between GOE and GUE behavior (while we 
expect GOE from physical symmetries, there is a maximum of about a 2% difference in their cumulative distribution 
functions). Current research in quantum dots (see LAlhJ ) shows promise for obtaining sufficiently large data sets to detect 
such subtle differences. 
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Figure 2: Plots of the three Tracy-Widom distributions, normaUzed to have mean and variance 
1, and the standard normal. 




Table 1 : Parameters for the Tracy-Widom distributions (before being normalized to have mean 
and variance 1). Fjs is the cumulative distribution function for fp, and Fpdip) is the mass of 
to the left of its mean. 





Mean /i 


Standard Deviation a 




TW(/3 = 1) 


-1.2065 


1.26798 


0.519652 


TW(/3 ^ 2) 


-1.7711 


0.90177 


0.515016 


TW(/3 = 4) 


-2.3069 


0.71953 


0.511072 


Standard Normal 


0.0000 


1.00000 


0.500000 



was less than the sample mean. We compared this percentage to the three different values for the 
Tracy-Widom distribution and the value for the standard normal (which is just .5). As the four 
percentages are different, this comparison provides evidence that, of the four distributions, the 
second largest eigenvalues are modeled only by a /3 = 1 Tracy-Widom distribution. 

We now briefly summarize our results and the conjecture they suggest. We concentrate on the 
families (see Remark fTTTI for definitions) ClM^di '^CIjv CBN,d and SCB^ d with d G {3, 4}, as 
weU as CXnj and CIn.w For each TV € {26, 32, 40, 50, 64, 80, 100, 126, 158, 200, 252, 316, 
400, 502, 632, 796, 1002, 1262, 1588, 2000, 2516, 3168, 3990, 5022, 6324, 7962, 10022, 12618, 
15886, 20000}, we randomly chose 1000 graphs from each family. We analyze the data for the 
3-regular graphs in ^ As the results are similar, the data and analysis for the other families 
are available online at http://www.inath.princeton.edu/mathlab/ramanujan/ 
(where we include our data for d = 3 as weU). 



• x^-tests for goodness of fit. x^-tests show that the distribution of the normalized eigen- 
values A± (G) are well modeled by a /? = 1 Tracy-Widom distribution, although the other 
two Tracy-Widom distributions and the standard normal also provide good fits; see Tables 
|2]and[3] The x^-values are somewhat large for small N < 100, but once N > 200 they are 
small for all famihes except for the connected bipartite graphs, indicating good fits. For the 
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connected bipartite graphs, the values are small for N large. This indicates that perhaps 
the rate of convergence is slower for connected bipartite graphs; we shall see additional 
differences in behavior for these graphs below. Further, on average the x'^-values are low- 
est for the f3 = 1 case. While this suggests that the correct model is a /3 — 1 Tracy- Widom 
distribution, the data is not conclusive. 

• Percentage of eigenvalues to the left of the mean. As remarked, the four distributions, 
while close, differ in the percentage of their mass to the left of their mean. By studying the 
percentage of normalized eigenvalues in a sample less than the sample mean, we see that 
the (3=1 distribution provides a better fit to the observed results; however, with sample 
sizes of 1000 all four distributions provide good fits (see Table|4|. We therefore increased 
the number of graphs in the samples from 1000 to 100,000 for N e {1002, 2000, 5002} for 
the four families; increasing the sample size by a factor of 100 gives us an additional deci- 
mal digit of accuracy in measuring the percentages. See Table|5]for the results; this is the 
most important experiment in the paper, and shows that for the families CIna^ SCImm^ 
and SCBN,d the /? = 1 Tracy-Widom distribution provides a significant fit, but the other 
three distributions do not. Thus we have found a statistic which is sensitive to very fine 
differences between the four normalized distributions. However, none of the four candi- 
date distributions provide a good fit for the family CBna for these values of N . For this 
family the best fit is still with j3 = \, but the ^-statistics are high (between 3 and 4), which 
suggests that either the distribution of eigenvalues for c?-regular connected bipartite graphs 
might not be given by a /3 = 1 Tracy-Widom distribution, or that the rate of convergence 
is slower; note our -tests suggests that the rate of convergence is indeed slower for the 
connected bipartite family. In fact, upon increasing N to 10022 we obtain a good fit for 
connected bipartite graphs; the z-statistic is about 2 for j3 = \, and almost 5 or larger for 
the other three distributions. We shall see below that there are other statistics where this 
family behaves differently than the other three, strongly suggesting its rate of convergence 
is slower 

• Independence of A±(G'). A graph is Ramanujan if |A±(G')| < 1. For bipartite graphs it 
suffices to study A+(G), as A_(G) = —\+{G). For the non-bipartite families, however, 
we must investigate both. For our non-bipartite families we computed the sample correla- 
tion coefficienO for A+ (G) and A_ (G) as G varied through our random sample of 1000 
graphs with vertices. For the SClN,d families we found the correlation coefficients were 
quite small; when rf 3 they were in [—.0355, 0.0827]. For the Cl^.d the values were 
larger, but still small. When d = 3 the correlation coefficients were in [—0.0151, 0.2868], 
and all but two families with at least 5000 vertices had a correlation coefficient less than . 1 
in absolute value (and the values were generally decreasing with increasing N); see Figure 
|6]for the values. Thus the data suggests that A±(G) are independent (for non-bipartite 
families). 



'^The sample correlation coeiBcient r^y is S^y/^J SxxSyy, where Suv = ^"—i ("i — — ^) (with u the mean 
of the Ui's). By Cauchy-Schwarz, \rxy\ < 1- If the Xi and yi are independent then rxy = 0, though the converse need 
not hold. 
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• Percentage of graphs that are Ramanujan. Except occasionally for the connected bi- 
partite families, almost always s±{!FN.d) > rn^i^TN^)- Recall our normalization of the 
eigenvalues from (|1.4| i: 



A±(G) 



(1.9) 



Log-log plots of the differences between the sample means and the predicted values, and 
standard deviations yield behavior that is approximately linear as a function of log N, sup- 
porting the claimed normalization. Further, the exponents appear to be almost constant in 
N, depending mostly only on d (see Figure |4|i. If this behavior holds as — > cx) then 
in the limit approximately 52% of the time we have \+{G) < 2y/d — 1 (and similarly 
about 52% of the time |A_(G)| < 2^/d~l. As A_(G) = -A+(G) for bipartite graphs, 
this implies that about 52% of the time bipartite graphs will be Ramanujan. Non-bipartite 
families behave differently. Assuming A_|_(G) and A_(G) are independent, the probability 
that both are at most 2\^d — 1 in absolute value is about 27% (52% • 52%). See Figure]?] 
for plots of the percentages and Coniecture ll.3l for exact statements of these probabilities. 
Unfortunately the rate of convergence is too slow for us to see the conjectured limiting 
behavior 

Based on our results, we are led to the following conjecture. 

Conjecture 1.3. Let Tna be one of the following families of d-regular graphs: CTM,d, SCTN,d, 
or SCBna (see Remark \l.l\f or definitions). The distribution of \±(G), appropriately normal- 
ized as in ( 1 1 A\ , converges as N ^ oo to the (3 — 1 Tracy-Widom distribution (and not to a 
normalized [3 = 2 or (3 — A Tracy-Widom distribution, or the standard normal distribution). 
For non-bipartite graphs, A_|_(G) and A_(G) are statistically independent. The normalization 
constants have c^^N,d.± < and s±{!Fiq,d) > 'm-±{^N,d)y implying that in the limit as N oo 
approximately 52% of the graphs in the bipartite families and 27% otherwise are Ramanujan 
(i.e., A(G) < 2\/ d — 1); the actual percentage for the bipartite graphs is the percent of mass in 
a [3 — \ Tracy-Widom distribution to the left of the mean (to six digits it is 51.9652%), and the 
square of this otherwise. 

Remark 1.4. The evidence for the above conjecture is very strong for three families. While 
the conjecture is likely to be true for the connected bipartite graphs as well, different behavior 
is observed for smaller TV, though this may simply indicate a slower rate of convergence. For 
example, when we studied the percentage of eigenvalues to the left of the sample mean, this 
was the only family where we did not obtain good fits to the normalized (3 = 1 Tracy-Widom 
distribution for N < 5002, though we did obtain good fits at TV = 10022 (see Table|5j 
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2 Results for 3-Regular Graphs 



For N e {26, 32, 40, 50, 64, 80, 100, 126, 158, 200, 252, 316, 400, 502, 632, 796, 1002, 
1262, 1588, 2000, 2516, 3168, 3990, 5022, 6324, 7962, 10022, 12618, 15886, 20000}, we 
randomly chose 1000 3-regular graphs from the families djv,3, SCTn,3, CBn,3 and SCBn,z- 
We analyzed the distributions of \±{G) for each sample using Matlab's eigs functiorQ and 
investigated whether or not it is well-modeled by the P — \ Tracy-Widom distribution. Further, 
we calculated what percent of graphs were Ramanujan as well as what percent of graphs had 
|A-|-(G)| less than the sample mean; these statistics help elucidate the behavior as the number of 
vertices tends to infinity. 

2.1 Distribution of \±{G) 

In Figure[3]we plot the histogram distribution of A+ (G) for CIn,3', the plots for the other families 
and for A_ (G) are similar This is a plot of the actual eigenvalues. To determine whether or not 
the (3—1 Tracy-Widom distribution (or another value of /3 or even a normal distribution) gives a 
good fit to the data we rescale the samples to have mean and variance 1, and then compare the 
results to scaled Tracy-Widom distributions (and the standard normal). In Table|2]we study the 
X^-values for the fits from the three Tracy-Widom distributions and the normal distribution. 

Figure 3: Distribution of A+(G) for 1000 graphs randomly chosen from the ensemble CIn,3 
for various N. The vertical fine is 2^/2 and N e {3990, 5022, 6324, 7962, 10022, 12618}. The 
curve with the lowest maximum value corresponds to iV = 3990, and as N increases the maxi- 
mum value increases (so N = 12618 corresponds to the curve with greatest maximum value). 




2.82 2.822 2.824 2.826 2.823 2.83 2.832 2.834 



"The Matlab code wa.s originally written to inve.stigate bipartite graphs. The symmetry of the eigenvalues allowed 
us to just look at the second largest eigenvalue; when we ran the code for non-bipartite graphs, we originally did not 
realize this had been hardwired. Thus there we were implicitly assuming A(G) = \+(G), which is frequently false for 
non-bipartite graphs. This error led us to initially conjecture 52% of these graphs are Ramanujan in the limit, instead of 
the 27% we discuss later 
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Table 2: Summary of x^-values: each set is 1000 random 3-regular graphs from CJjv,3 with 
N G {26, 32, 40, 50, 64, 80, 100, 126, 158, 200, 252, 316, 400, 502, 632, 796, 1002^ 1262, 
1588, 2000, 2516, 3168, 3990, 5022, 6324, 7962, 10022, 12618, 15886, 20000}. The sample 
distribution in each set is normalized to have mean and variance 1, and is then compared to 
normalized Tracy-Widom distributions TW'^°™ {(3 S {1,2, 4}, normalized to have mean and 
variance 1) and the standard normal N(0, 1). There are 19 degrees of freedom, and the critical 
values are 30.1435 (for a = .05) and 36.1908 (for a = .01). 



N 






TWf™ 


N(0,1) 


mean (all N) 


27.0 


24.5 


24.0 


29.4 


median (all A^) 


21.2 


19.1 


20.0 


26.5 


mean (last 10) 


21.7 


22.2 


23.7 


35.0 


median (last 10) 


21.2 


20.9 


22.4 


35.4 
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Table 3: Summary of x^-values: each set is 1000 random 3-regular graphs with N vertices from 
our famines, with N e {26, 32, 40, 50, 64, 80, 100, 126, 158, 200, 252, 316, 400, 502, 632, 796, 
1002, 1262, 1588, 2000, 2516, 3168, 3990, 5022, 6324, 7962, 10022, 12618, 15886, 20000}. 
The sample distribution in each set is normalized to have mean and variance 1, and is then 
compared to the normalized /3 = 1 Tracy-Widom distributions. There are 19 degrees of freedom, 
and the critical values are 30.1435 (for a = .05) and 36.1908 (for a = .01). 



N 




SCIn.3 


CBn,3 


SCBn,3 


mean (all N) 


27 


19 


78 


19 


standard deviation (all N) 


21 


8 


180 


7 


mean (last 10) 


22 


18 


44 


17 


standard deviation (last 10) 


11 


6 


37 


8 


mean (last 5) 


23 


18 


32 


14 


standard deviation (last 5) 


13 


8 


23 


1 



As Table |2] shows, the three normalized Tracy-Widom distributions all give good fits, and 
even the standard normal gives a reasonable fit0 We divided the data into 20 bins and calculated 
the x^-values; with 19 degrees of freedom, the a = .05 threshold is 30.1435 and the a = .01 
threshold is 36.19080 We investigate below another statistic which is better able to distinguish 
the four candidate distributions. We note that the normalized (3=1 distribution gives good fits 
as N ^ oo for all the families, as indicated by Table [3] The fits are good for modest N for all 
families but the connected bipartite graphs; there the fit is poor until N is large. This indicates that 
the connected bipartite graphs may have slower convergence properties than the other families. 

In Table[T]we listed the mass to the left of the mean for the Tracy-Widom distributions; it is 
0.519652 for /3 = 1, 0.515016 for /3 = 2 and 0.511072 for /3 = 4 (note it is .5 for the standard 
normal). Thus looking at the mass to the left of the sample mean provides a way to distinguish 
the four candidate distributions; we present the results of these computations for each set of 1000 
graphs fromCX7v,3 in Table|4](the other families behave similarly). If 6'obs is the observed percent 
of the sample data (of size 1000) below the sample mean, then the z-statistic 

Z = {0ohs - Oprod) / \/Vcd • (1 - 0prcd)/lOOO (2.1) 

measures whether or not the data supports that (?prcd is the percent below the mean. 

While the data in Table|4]suggests that the /3 = 1 Tracy-Widom is the best fit, the other three 
distributions provide good fits as well. As we expect the fit to improve as N increases, the last 
few rows of the table are the most important. In 5 of the last 10 rows the smallest z-statistic 
is with the (3 = 1 Tracy-Widom distribution. Further, the average of the absolute values of the 
z-values for the last 10 rows are 0.861 ((3 = 1), 0.873 ((3 = 2), 0.960 ((3 = 4) and 1.341 (for 
the standard normal), again supporting the claim that the best fit is from the (3=1 Tracy-Widom 
distribution. 

'''while the data displayed above is for X-^-{G), the values for A_ (G) and A(G) are comparable. 
'^We could use the (pessimistic) Bonferroni adjustments for multiple comparisons (for ten comparisons these numbers 
become 38.5822 and 43.8201); we do not do this as the fits are already quite good. 
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Table 4: The mass to the left of the sample mean for X+{G) from each set of 1000 3-regular 
graphs from djv^s and the corresponding z-statistics comparing that to the mass to the left of 
the mean of the three Tracy- Widom distributions (0.519652 for /3 = 1, 0.515016 for f3 = 2, 
0.51 1072 for (3 = 4:) and the standard normal (.500). We use the absolute value of the z-statistics 
for the means and medians. For a two-sided z-test, the critical thresholds are 1.96 (for a = .05) 
and 2.575 (for a = .01). For brevity we report only some of the values for N S {26, 32, 40, 50, 
64, 80, 100, 126, 158, 200, 252, 316, 400, 502, 632, 796, 1002, 1262, 1588, 2000, 2516, 3168, 
3990, 5022, 6324, 7962, 10022, 12618, 15886, 20000}, but Hst the mean and medians for the last 
5 and last 10 values of N. 



N 


Observed mass 


ZTW,1 


ZTW,2 


ZTW,4 


^StdNorm 


26 


0.477 


-2.700 


-2.405 


-2.155 


-1.455 


100 


0.522 


0.149 


0.442 


0.691 


1.391 


400 


0.522 


0.149 


0.442 


0.691 


1.391 


1588 


0.526 


0.402 


0.695 


0.944 


1.644 


6324 


0.524 


0.275 


0.568 


0.818 


1.518 


20000 


0.551 


1.984 


2.277 


2.526 


3.226 


mean (last 10) 


0.519 


0.861 


0.873 


0.960 


1.341 


median (last 10) 


0.519 


0.696 


0.758 


0.854 


1.170 


mean (last 5) 


0.514 


1.186 


1.126 


1.076 


1.138 


median (last 5) 


0.508 


1.434 


1.140 


0.890 


0.506 



In order to obtain more conclusive evidence as to which distribution best models the second 
largest normalized eigenvalue, we considered larger sample sizes (100,000 instead of 1000) for 
all four families; see Table|5]for the analysis. While there is a sizable increase in run-time (it took 
on the order of a few days to run the simulations for the three different values of N for the four 
families), we gain a decimal digit of precision in estimating the percentages. This will allow us 
to statistically distinguish the four candidate distributions. 

This is the most important test in the paper. The results are striking, and strongly support that 
only the (3=1 Tracy-Widom distribution models X±{G) (the results for A_(G) were similar 
to those for A+(G')). Except for 5CSioo2,3, for each of the families and each N the z-statistic 
increases in absolute value as we move from /3 = lto/3 = 2to/? = 4to the standard normal. 
Further, the z-values indicate excellent fits with the (3=1 distribution for all N and all families 
except the 3-regular connected bipartite graphs; no other value of (3 or the standard normal give 
as good of a fit. In fact, the other fits are often terrible. The (3 = 4 and standard normal typically 
have z-values greater than 4; the (3 = 2 gives a better fit, but significantly worse than (3=1. 

Thus, except for 3-regular connected bipartite graphs, the data is consistent only with a. (3 = 1 
Tracy-Widom distribution. In the next subsections we shall study the sample means, standard 
deviations, and percent of graphs in a family that are Ramanujan. We shall see that the 3-regular 
connected bipartite graphs consistently behave differently than the other three families (see in 
particular Figure |7]l. 
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Table 5: The mass to the left of the sample mean of X+{G) for each set of 100,000 3-regular 
graphs from our four famihes (C1n,3, SCXn,3, CBn.s and SCBm.z), and the corresponding z- 
statistics comparing that to the mass to the left of the mean of the three Tracy-Widom distributions 
(0.519652 for /3 = 1, 0.515016 for /3 = 2, 0.51 1072 for /? = 4) and the standard normal (.500). 
Discarded refers to the number of graphs where Matlab's algorithm to determine the second 
largest eigenvalue did not converge; this was never greater than 4 for any data set. For a two- 
sided z-test, the critical thresholds are 1.96 (for a — .05) and 2.575 (for a = .01). 





ztw,i 


2TW,2 


ZTW,4 


^StdNorm 


Discarded 


1002 


1.2773 


4.2103 


6.7044 


13.7053 





2000 


0.9671 


3.9002 


6.3944 


13.3954 





5022 


0.3152 


3.2485 


5.7428 


12.744 





SCIn.3 


ztw,i 


2TW,2 


ZTW,4 


^StdNorm 


Discarded 


1002 


-0.7481 


2.1855 


4.6801 


11.6815 





2000 


-0.5899 


2.3437 


4.8382 


11.8396 





5022 


-1.0456 


1.8881 


4.3827 


11.3842 





CBn,3 


ztw.i 


ZtW.2 


ztwa 


^StdNorm 


Discarded 


1002 


3.151 


6.083 


8.577 


15.577 





2000 


3.787 


6.719 


9.213 


16.213 


1 


5022 


3.563 


6.495 


8.989 


15.989 


4 


10022 


2.049 


4.982 


7.476 


14.477 





SCBn,3 


ztw.i 


ZTW.2 


ztwa 


Z^StdNorm 


Discarded 


1002 


-1.963 


0.971 


3.465 


10.467 





2000 


-0.767 


2.167 


4.661 


11.663 


2 


5022 


-0.064 


2.869 


5.364 


12.365 


4 



2.2 Means and Standard Deviations 

In Figure m we plot the sample means of sets of 1000 3-regular graphs chosen randomly from 
CIn,3 (connected perfect matchings), SCIn,3 (simple connected perfect matchings), CBn,3 
(connected bipartite) and SCBm,3 (simple connected bipartite) against the number of vertices. 

Because of analogies with similar systems whose largest eigenvalue satisfies a Tracy-Widom 
distribution, we expect the normalization factor for the second largest eigenvalue to be similar to 
that in (|1.7| i. As we do not expect that the factors will still be A^^/^ and N^^^, we consider the 
general normalization given in ilAi : for a 3-regular graph in one of our families we study 



Remark 2.1. The most important parameters are the exponents m± {Tn,3) and s± {J^n,3)\ previ- 
ous work|Fr2| (and our investigations) suggest that c^ jv,3,± < 0. Let us assume that, in the limit 
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Figure 4: Sample means of X+{G): each set is 1000 random 3-regular graphs with A'^ vertices, 
chosen according to the specified construction. The first plot is the mean versus the number of 
vertices; the second plot is a log-log plot of the mean and the number of vertices. CIn,3 are stars, 
SCXn,3 are triangles, CBn,3 are diamonds, SCBn,3 are boxes; the dashed hne is 2\/2 k, 2.8284. 



2.828 - 



2.827 - 



2.826 - 



2.825 - 




5000 10000 15000 20000 



'-4 
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as the number of vertices tends to infinity, the distributions of |A±(G)| converge to the /3 — 1 
Tracy-Widom distribution and that c^^n,3,± < 0. If s±(^jv,3) > iti±{!Fn,3) then in the Hmit we 
expect about 52% of the graphs to have A+ (G) < 2\/2 (and similarly for | A_ (G) |), as this is the 
mass of the f3 — 1 Tracy-Widom distribution to the left of the mean. To see why this is true, note 
that if HjTj^ 3 ^ and cr^r^ ^ ^ are the mean and standard deviation of the data set of A+ (G) for all 

G G J^N,3, then /z^^ ^^ « 2\/2 - c^^Ar^d,+iV™+(-^«.=') and w Ca,N,3,+N''+(^^'^-'\ so 

2\/2 « 3 ^ + 2t2m± . ^™+(^„,3)-.+(^«,3) .a^^^^, (2.3) 

Ca,N,3,+ 

Thus the Ramanujan threshold, 2\/2, will fall approximately I'^-'^'l'^ ]\[ni+{:^N.3)-s+{rN.3) stan- 
dard deviations away from the mean. In the limit as N goes to infinity we see that the threshold 
falls zero standard deviations to the right of the mean if m+(jF^r 3) < s+(.FAr 3), but infinitely 
manyif TO+(J^Ar^3) > s+{J^n,3)- 



Table 6: The graph sizes are chosen from {26, 32, 40, 50, 64, 80, 100, 126, 158, 200, 252, 316, 
400, 502, 632, 796, 1002, 1262, 1588, 2000, 2516, 3168, 3990, 5022, 6324, 7962, 10022, 12618, 
15886, 20000}. The first four columns are the best-fit values of m{!FM.3)', the last four columns 
are the best fit values of s{Tm,3)- Bold entries are those where s{Tn,3) < iti{!Fn,3)', all other 
entries ai-e where s(J^Ar^3) > 'm{TM,3)- 



N 


C2n,3 


SCJn.3 


CBn,3 


SCBn,3 


C2n,3 


SCIn,3 


CBn,3 


SCBn,3 


{26, . . . 


,20000} 


-0.792 


-0.830 


-0.723 


-0.833 


-0.718 


-0.722 


-0.709 


-0.729 


{80, . . . 


,20000} 


-0.756 


-0.790 


-0.671 


-0.789 


-0.701 


-0.700 


-0.697 


-0.706 


{252,... 


,20000} 


-0.727 


-0.761 


-0.638 


-0.761 


-0.695 


-0.688 


-0.688 


-0.696 


{26 


...,64} 


-1.045 


-1.097 


-1.065 


-1.151 


-0.863 


-0.906 


-0.794 


-0.957 


{80, 


..,200} 


-0.887 


-0.982 


-0.982 


-0.968 


-0.769 


-0.717 


-0.719 


-0.750 


{232, 


..,632} 


-0.801 


-0.885 


-0.737 


-0.842 


-0.688 


-0.713 


-0.714 


-0.734 


{796, . 


. , 2000} 


-0.771 


-0.819 


-0.649 


-0.785 


-0.606 


-0.719 


-0.705 


-0.763 


{2516,. 


.,6324} 


-0.745 


-0.788 


-0.579 


-0.718 


-0.714 


-0.671 


-0.770 


-0.688 


{7962, . . . 


,20000} 


-0.719 


-0.692 


-0.584 


-0.757 


-0.592 


-0.707 


-0.671 


-0.648 



We record (some of) the best fit exponents in Table |6l the remaining values are similar. To 
simplify the calculations, we changed variables and did a log-log plot. Several trends can be seen 
from the best fit exponents in Table|6l Most of the time, s± {^-^,3) > m± {J-n,3), which indicates 
that it is more likely in the limit that 52% (and not all) of the bipartite graphs are Ramanujan (and 
about 27% of the non-bipartite). Except for CBn.3 (connected bipartite graphs), only once is 
s+(J^iv,3) < iTi+i^N,3)', for CyBjv, 3 we have s+(.FAr^3) < m+(J^jv,3) approximately half of 
the time. Further, the best fit exponents s+(.FAr 3) and m+(jFjv,3) are mostly monotonically 
increasing with increasing N (remember all exponents are negative), and jv,3,+ and Ca,N,3,+ 
do not seem to get too large or small (these are the least important of the parameters, and are 
dwarfed by the exponents). This suggests that either the relationship is more complicated than 
we have modeled, or N is not large enough to see the limiting behavior While our largest N 
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Figure 5: Dependence of the logarithm of the mean of A+(G) on log (— c^,Ar,3,+-/V™+(''-^™'3^) 
on N, showing the best fit lines using all 30 values of N as well as just the last 10 values. 




is 20000, log(20000) is only about 10. Thus we may not have gone far enough to see the true 
behavior. If the correct parameter is log N, it is unlikely that larger simulations will help. 

In Figure |5] we plot the iV-dependence of the logarithm of the difference of the mean from 
versus the logarithm of — ^r^a _|_Af™+(''-^"'^', as well as the best fit lines obtained by using 
all of the data and just the last 10 data points. As the plot shows, the slope of the best fit line (the 
key parameter for our investigations) noticeably changes in the region we investigate, suggesting 
that either we have not gone high enough to see the hmiting, asymptotic behavior or that it is not 
precisely linear 

2.3 Independence of X±{G) in non-bipartite families 

In determining what percentage of graphs in a non-bipartite family is Ramanujan, it is important 
to know whether or not A+(G) and A_(G) are statistically independent as G varies in a family. 
For example, if they are perfectly correlated the percentage could be 100%, while if they are 
perfectly anti-correlated it could be 0%. 

In Figure|6]we plot the sample correlation coefficient for X± (G) for the non-bipartite families. 
For CIn,3 the values are generally positive and decreasing with increasing N; for SCIn,3 the 
data appears uncorrected, with very small coefficients oscillating about zero. As another test we 
compared the product of the observed probabilities that A_|_(G) < 2^/2 and |A_(G)| < 2\/2 to 
the observed probability that A(G) < 2\/2; these values were virtually identical, which is what 
we would expect if A±(G) are statistically independent. 
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Figure 6: Sample correlation coefficients of \±{G): each set is 1000 random 3-regular graphs 
with N vertices, chosen according to the specified construction. We plot the sample correlation 
coefficient versus the logarithm of the number of vertices. CXjv.3 are stars and SCTn,3 are 
triangles. 




2.4 Percentage of graphs that are Ramanujan 

In Figure I2] we plot the percentage of graphs in each sample of 1000 from the four families that 
are Ramanujan (the first plot is the percentage against the number of vertices, the second is the 
percentage against the logarithm of the number of vertices). The most interesting observation is 
that, for the most part, the probability that a random graph from the bipartite families is Ramanu- 
jan is decreasing as N increases, while the probability that a random graph from the non-bipartite 
families is Ramanujan is oscillating in the range. 
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Figure 7: Percent Ramanujan: each set is 1000 random 3-regular graphs with N vertices, chosen 
according to the specified construction. The first plot is the percent versus the number of vertices; 
the second plot is the percent versus the logarithm of the number of vertices. C1n,3 are stars, 
<SCXjv,3 are diamonds, CBjv,3 are triangles, SCBn,3 are boxes. 
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